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Canon Kabushiki Kaisha, incorporated in Japan, of 30-2, Shimomaruko 3- 
chome, Ohta-ku, Tokyo, 146, Japan 
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Mikhail Prokopenko 



This invention is best described in the following statement: 



A TELEVISION PROGRAM RECOMMENDATION SYSTEM WITH ADAPTIVE 

FILTERING 

Field of the Invention 

The present invention relates to television program selection and more particularly 
to a system for providing recommendations for television program selection. 

Description of Background Art 

Watching television is an everyday activity in a large number of households, and 
provides for a source of entertainment for a range of program content such as sport and 
movies, as well as news and actuality programs (eg. documentaries and lifestyle). 

Traditionally, a viewer would consult a printed television schedule listing in a local 
newspaper or periodical to find a desirable program to watch. More recently, 
entertainment program guides have been made available in electronic form via the 
Internet or World Wide Web. However, with the introduction of satellite receivers for 
television and cable television, the number of television channels available to the viewer 
has increased dramatically. This has made the task of selecting a television program to 
watch using either printed program listings or on-screen Electronic Programming Guides 
(EPG) very involved and time consuming. 

Program listings that are ordered by characteristics including category, time or 
performers, can assist the viewer in making a selection, but such remains a time 
consuming task. Typically, there may only be a few programs of interest to the viewer 
out of the vast number of available programs. 

Systems are available that monitor those categories of programs a viewer most 
frequently watches and to provide recommendations based on the most frequently 
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watched category. Such arrangements suffer from the disadvantage of simply selecting a 
single program characteristic (namely category) from previously watched programs and 
making recommendations based on this selected program characteristic. However, 
selection by the viewer may depend on various characteristics and even combinations of 
characteristics. Furthermore, exactly how these characteristics and combinations of 
characteristics are joint for use in making the selection is highly individual for each user 
and prior art systems do not provide this level of flexibility. 

Disclosure of the Invention 

It is an object of the present invention to substantially overcome, or at least 
ameliorate, one or more disadvantages of existing arrangements. 

According to a first aspect of the invention, there is provided a recommendation 
system for making recommendations to a user of programs for viewing in a television 
system in which information regarding programs is made available as at least one 
program guide list, the system comprising: 

a first memory means for recording a plurality of characteristics associated with 
each program previously viewed by said user; 

a second memory means for recording each of a plurality of relationships and 
corresponding measures of acceptance of said user, with respect to program 
recommendations made in response to previous program requests; 

processing means for forming sets of said characteristics, each said set 
comprising at least two of said characteristics; 

task selection means for selecting from said relationships at least one 
relationship, wherein at least one of said selected relationships comprises a highest one of 
said measures of acceptance; 
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ordering means for ordering said sets of characteristics using said selected 
relationship to produce ordered sets of characteristics; 

filtering means for filtering said ordered sets of characteristics using said 
selected relationship to produce filtered sets of characteristics; 

searching means for performing a search of each of said program guide lists for 
programs with information that best match said filtered sets of characteristics, giving 
preference to highest filtered sets of characteristics; and 

on-screen display means for notifying said user of an availability of programs that 
best match said filtered sets as program recommendations upon entry of a user request for 
program recommendations. 

According to another aspect of the invention there is provided a method of 
making recommendations to a user of programs for viewing in a television system 
wherein: 

information regarding programs is made available as at least one program guide 

list; 

a plurality of characteristics associated with each program previously viewed by 
said user, and each of a plurality of relationships and corresponding measures of 
acceptance of said user, with respect to program recommendations made in response to 
previous program requests, have been recorded; 

said method comprising the steps of: 

forming sets of said characteristics, each said set comprising at least two of said 
characteristics; 

selecting from said relationships at least one relationship, wherein at least one of 
said selected relationships comprises a highest one of said measures of acceptance; 



489073.doc 



ordering said sets of characteristics using said selected relationship to produce 
ordered sets of characteristics; 

filtering said ordered sets of characteristics using said selected relationship to 
produce filtered sets of characteristics; 

performing a search of each of said program guide lists for programs with 
information that best match said filtered sets of characteristics, giving preference to 
highest filtered sets of characteristics; and 

notifying said user of an availability of programs that best match said filtered sets as 
program recommendations upon entry of a user request for program recommendations. 

Brief Description of the Drawings 

A preferred embodiment of the present invention will now be described with 
reference to the drawings, in which: 

Fig. 1 A is a schematic representation of a system according to an embodiment of 
the invention; 

Fig. IB is a detailed representation of an avatar agent of the system in Fig. 1A; 

Fig. 2 is an extract from a typical Electronic Program Guide; 

Fig. 3 is an illustration of an animated character displayed on a display screen of 
the system in Fig. 1 A; 

Fig. 4 is an example of how recommendations may be presented to a viewer by 
the system in Fig. 1 A; 

Fig. 5 is an example of a selection made from the recommendations in Fig. 4; 

Fig. 6 is an example of a viewer profile database; 

Figs 7A to 7K are flow diagrams of a method performed by a learning module of 
the avatar agent illustrated in Fig. 1 A, to learn common features from selections made by 
the viewer; and 
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Fig. 8 is a schematic block diagram of a general purpose computer upon which 
an embodiment of the present invention can be practiced; 

Figs. 9 A to 9F are flow diagrams of a method performed by a recommendation 
module of the avatar agent illustrated in Fig. IB, reasoning to best use the results from the 
learning module to make recommendations of programs to watch to the viewer. 

Detailed Description including Best Mode 

Fig. 1A shows a system 50 for automatically suggesting suitable programs to a 
viewer from a large number of available programs. The system 50 comprises a digital 
television (DTV) 10 connected through interconnection 25 to a "set top" box 20. The "set 
top" box 20 is also connected through a gateway 41 to an external network 42. A number 
of content servers 43 and Electronic Program Guide (EPG) databases 22 are connected to 
the external network 42. The content servers 43 are typically provided by content 
providers and contain multimedia content including movies and television programs. 

The available programs are listed in the EPG databases 22. Each of the content 
providers may maintain an associated EPG database 22. The available programs listed in 
the EPG databases 22 may be linked to the corresponding multimedia content in the 
content servers 43 by means of a program identifier. An extract from a typical EPG 
database 22 is shown in Fig. 2. The EPG database 22 has a number of program entries 
60, each of which may include a number of attributes 61 with values 62. The attributes 
61 may include: 

EPG ID which is a unique number per entry; 

Program ID which is unique for each program resulting in re-runs having the same 
Program ID; 
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- Category ED, for example *0r for art, '16' for drama, '50* for Movies and Series, 
'75' for sport etc.; 

Subcategory ED, for example, in the movies category '50', the subcategory '001* 
for action/adventure, '064' for comedy, '074' for crime etc; 

- Title; 

Remarks, which is a general text field about the program entry; 

Keywords; 

Rating; 

- EPG Channel; 

- Start Day; 

- Start Date; 
Start time; 
Duration; and 
Year of Make. 



A DTV-agent system 21 is preferably formed within the "set top" box 20. In use, 
the viewer interacts with the DTV-agent system 21 using a remote control device 30. The 
DTV-agent system 21 may alternatively be integrated into the DTV 10 or incorporated 
into a personal computer 100 such as that seen in Fig. 8 and appropriately interfaced with 
the DTV 10. 

In the preferred embodiment, the DTV-agent system 21 includes a DTV-agent 36 
for controlling the DTV 10, and a number of avatar-agents 37, each avatar-agent 37 
representing a particular viewer. An Inter-agent-server (IAS) 35 manages all inter-agent 
communications and also interfaces with the gateway 41. The DTV-agent system 21 
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further includes a number of viewer profile databases 23 accessed by the avatar-agents 

37. The functions of the DTV-agent 36 include: 

the provision of a graphical user interface via a display screen 11 of the DTV 10 
by which recommendations are made to the viewer and to enable the viewer to 
make selections; 

to control the functionality of the DTV 10 including interacting with a television 
tuner module (not illustrated) thereof to select a channel for viewing from the 
plurality of available television channels; and 

to gather viewer selections and delivers them to the avatar agents 37. 

Each of the avatar-agents 37 is associated with a single viewer and a 
corresponding one of the viewer profile databases 23. As seen in Fig. IB, each avatar- 
agent 37 includes an avatar manager 38 that maintains control of the particular avatar- 
agent 37. The avatar manager 38 accesses the EPG databases 22 through the IAS 35 to 
obtain television program information and the associated viewer profile database 23 to 
build and maintain the viewer profile. The avatar manager 38 is also responsible for 
sending messages to, and receiving messages from, the DTV-agent 36 through the IAS 
35. Within the avatar-agent 37, the avatar manager 38 is also responsible for interfacing 
with each of a learning module 39 and a recommendation module 40. One task of the 
avatar-agent 37 is to build and maintain the viewer profile database 23 based on 
selections made by the viewer and processed by the learning module 39. The avatar- 
agent 37 then also uses the viewer profile database 23 to provide recommendations to the 
viewer by processing performed in the recommendation module 40. The 
recommendations are for the most suitable viewing options available for a specific viewer 
and are provided to the viewer via the display screen 1 1 . 
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Referring again to Fig 1A, the system 500 may further include an EPG agent 44 
that interfaces with both the EPG databases 22 and the IAS 35. The EPG agent 44 
accesses the EPG databases 22 and extract further attributes from the program entries 60, 
which includes Popularity, Urgency and Lifestyle. The Popularity attribute indicates 
whether a program entry 60 corresponds to a (currently) popular event/program, such as 
the Football World Cup or a concert by a popular performer. The Urgency attribute 
indicates whether a program entry 60 corresponds with an urgent program, such as special 
news/progress reports, weather announcements (tornado warnings, etc.), press 
conferences, nation addresses and so on. The Lifestyle attribute indicates that the 
program entry 60 corresponds to a certain type of lifestyle, such as Midday movies, 7pm 
news, or Saturday night music shows. The values of these further attributes are True or 
False. In an alternative embodiment, these attributes are already included in the EPG 
databases 22. 

Referring to Tables 1 and 2, examples of typical steps for use of the system 50 
will now be described. 
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10# 
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AA 
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EPG and preview data retrieved. 


12 








Preview data are displayed on 










display screen 1 1 . Viewer makes 










a selection 68. 


13 


SetProgramSe lection 


DTVA 


AA 





Note: When the sequence shown in Table 1 reaches a star symbol (*), the DTV- 
agent 36 enters an "idle" mode, waiting for messages from avatar agent 37. In this mode, 
the DTV 10 displays a television program (on a channel most recently selected by the 
5 viewer). Sequence points indicated by a hash symbol (#) can be accessed at any time 
(i.e. asynchronously). 



Table 1 illustrates a sequence of events and resulting messages to and from the 
io DTV-agent 36 in which: 

1. The user switches the DTV 10 'ON' using the remote control 30. 

2. The viewer needs to identify himself/herself to the DTV-agent system 21. 
Referring to Fig. 3, this may be done by selecting an animation character 12 
from a set of characters generated by the DTV-agent 36 and displayed on the 

is display screen 11. The selection may be performed using the remote control 

30. In the preferred embodiment, there may be three types of characters: 
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(i) Un-touched characters, meaning those that are not associated with any 
viewer; 

(ii) Dormant characters, meaning those that are associated with a viewer but that 
particular viewer is currently not engaged; and 

(iii) An active character 12, identifying that the associated viewer is presently 
selected. No active character will be present when the DTV 10 has just been 
turned 'ON'. 

3. A SetAnimationSelection message is sent to the avatar agents 37, activating 
only the avatar-agent 37 associated with the identified viewer. 

4. A SendUserData message is received from the avatar agent 37, instructing the 
DTV agent 36 to collect viewer data. 

5. The DTV-agent 36 controls the display screen 11 of the DTV 10 for the 
collection of viewer data. The viewer provides the data using the remote control 
30. The first time that a character 12 is selected, the system 50 assumes that it is 
a new viewer using the system 50 and therefore an unregistered viewer. The 
avatar agent 37 has no viewer profile database for the currently unregistered 
viewer. 

The viewer may then be requested by the DTV-agent 36 to select one of a 
number of moods currently being experienced, again by making a selection with 
the remote control 30. Examples of such moods include happy, sad, neutral etc. 
A password may also be requested from the viewer when the program content is 
password-protected (eg. adult content). 

6. The viewer data are formatted and sent in a SetNewUserData message to the 
avatar-agent 37. The DTV agent 36 enters into the idle mode. 
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7. The viewer uses the remote control 30 to request from the DTV-agent system 21 
a list of recommended television programs. 

8. The DTV-agent 36 prompts the viewer for a time and date for which 
recommendations should be provided. Alternatively, recommendations may 
automatically be for television programs due to start in the following 
predetermined number of minutes. 

9. The time and date are formatted and sent to the avatar-agent 37 in a 
SendRecommendationRequest message. The DTV agent 36 enters into the idle 
mode. 

10. The avatar agent 37, and in particular the recommendation module 40, 
determines viewing recommendations for viewing from the EPG databases 22 
that best match the viewer's preferences for the given timeslot and the viewer 
mood. The avatar agent 37 sends these viewing recommendations in a 
SetRecommendations message to the DTV agent 36. 

11. Based on the recommended programs received from the avatar agent 37, data 
are retrieved from the EPG databases 22 and one or more preview databases 
(not shown). The preview databases may form part of the EPG databases 22 or 
alternatively, the content servers 43 and provide a brief example or preview of 
the content of a particular program. 

12. The DTV-agent 36 formats the viewing recommendations and displays the 
recommendations on the display screen 11. As illustrated in Fig. 4, the viewing 
recommendations 67 are preferably provided to the viewer on the display screen 
1 1 by displaying a set of previews. Alternatively, a bitmap image or a title only 
is displayed on the display screen 11, each of which representing a viewing 
recommendation 67. Additional information may also be displayed associated 
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with each of the recommendations 67. The viewing recommendations 67 may 
also be displayed in a manner to reflect the program attributes. For example, all 
the viewing recommendations 67 having a common category may be displayed 
together. The viewer views the viewing recommendations 67 and selects one of 
the viewing recommendations 67 using the remote control 30. The DTV-agent 
36 interacts with the DTV 10, which responds by tuning into a receiver channel 
on which the selected program is broadcast. The selected program 68 is then 
displayed on the full display screen 1 1 as shown in Fig. 5. 
13. Information about the selected program 68 is sent to the avatar agent 37 in a 
SetProgramSelection message. The DTV-agent 36 enters its idle mode while 
the selected program 68 is displayed on the display screen 1 1 . 

Table 2 illustrates a sequence of events and resulting messages to and from the 
avatar- agents 37 in which: 

1. A SetAnimationSelection message is received from the DTV-agent 36 by the avatar- 
agent 37 associated with the selected animation character 12. The other avatar-agents 
37 remain in the idle mode. 
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TABLE 2 



Step 


Message 


From 


To 


Internal processing 

m to 


1# 


SetAnimationSelection 


DTVA 


AA 




2 








Retrieve information from viewer 










profile database 23 to establish 










whether the viewer has profile data. If 










not, go to step 3. 


3 








Create viewer profile database 23. 


4 


SendViewerData 


AA 


DTVA 




5 


SetNewViewerData 


DTVA 


AA 




6 
* 


- 






Update viewer profile database 23. 


7# 


SendRecommendationRequest 


DTVA 


AA 




8 








Retrieve viewer profile and EPG 










information from databases 23 and 22. 


9 








Send viewer data and television 










program information to 










recommendation module 40. 


10 








Recommendation module 40 










constructs a list of recommended 










television programs 67. 


11 








Receive program recommendations 67 










from recommendation module 40. 


12 
* 


Set Recommendations 


AA 


DTVA 




13# 


SetProgramSe lection 


DTVA 


AA 




14 








Retrieve viewer profile and program 










data from databases 23 and 22. 


15 








Send viewer data and new program 










data to learning module 39. 


16 








The learning module 39 updates the 










Case-file. 


17 








Receive Case-file from learning 










module 39. 


18 
* 








Update viewer profile database 23. 



Note: When the sequence shown in Table 1 reaches a *, the avatar-agent 37 enters 
an "idle" mode, waiting for messages from the DTV-agent 36. In this mode, background 
processing by the learning module 39 and the recommendation module 40 may occur. 
Sequence points indicated by a hash symbol (#) can be accessed at any time 
(i.e. asynchronously). 
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2. The avatar agent 37 determines whether the selected character 12 corresponds to a 
viewer known to the DTV-agent system 21, or to a new viewer. If the viewer is not 
known to the DTV-agent system 21, the next sequence step is step 3. Otherwise the 
avatar manager 38 enters its idle mode. 

3. A profile for the new viewer is created in the viewer profile database 23. 

4. A SendViewerData message is sent to the DTV agent 36. 

5. A SetNewViewerData message is received from the DTV agent 36. This contains 
static viewer attributes. 

6. The avatar manager 38 stores the viewer attributes in the viewer profile database 23. 
The avatar manager 38 enters its idle mode. 

7. A SendRecommendationRequest message is received from the DTV agent 36. The 
viewer has requested that viewer recommendations 67 for a particular day and time be 
provided. Alternatively, recommendations may automatically be for television 
programs due to start in the following predetermined number of minutes. 

8. The avatar-manager 38 retrieve viewer profile data from viewer profile database 23 
and retrieve television program information from the EPG databases 22. The data is 
formatted for use by recommendation module 40. 

9. The viewer profile data and the program information are sent to the recommendation 
module 40 by the avatar manager 38. Alternatively, the recommendation module 40 
retrieves the data directly. 

10. The recommendation module 40 constructs a list of programs 67 to be recommended 
to the viewer. 

1 1 . The list of recommended programs 67 is sent from the recommendation module 40 to 
the avatar manager 38. 
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12. A SetRecommendations message, containing a list of recommended programs 67 is 
sent to the DTV agent 36. The avatar manager 38 enters its idle mode. 

13. A SetProgramSelection is received from the DTV agent 36, indicating that the viewer 
has selected a particular program 68. 

14. The program entry 60 about the selected program 68 is retrieved from the EPG 
database 22. The viewer profile is also retrieved from the viewer profile database 23. 

15. The selected program information is sent to the learning module 39 for updating of a 
Case-file. 

16. The learning module 39 updates the Case-file to take account of the selected program 
68. 

17. The updated Case-file is received by the avatar manager 38 from the learning module 
39. 

18. The updated Case-file is used to update the viewer profile database 23. The avatar 
manager 38 enters its idle mode. 

The operations within the learning module 39 will now be described in more 
detail. Each program is associated with a number of features (fi), each feature 
representing a unique attribute and attribute value pair. The attributes may include the 
program attributes 61 from the EPG database 22 (illustrated in Fig. 2) as well as viewer 
attributes when the selection was made. The viewer attributes may include for example 
the mood of the viewer. Each attribute has a number of possible values. An example of 
an attribute-value pair is Category = 'drama' where Category is the attribute and 'drama' 
is the attribute value. 

Each selection 68 made by the viewer is termed a case (Cj), and is defined by a set 
of features (fi). For example, a case may be {Category = 'drama', Sub-category = 
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* comedy-drama', EPG channel = 'Nhk', ...). The cases (Cj) may have different 
number of features (fi), dependent on the information available. All cases are stored in 
the viewer profile database 23 in a case file for use by the learning module 39. 

The learning module 39 operates to identify shared or generalisation patterns of 
features (fi) from a number of cases (Cj) from the case file. The learning module 39 takes 
the case file as input and generates a Generalisation Pattern List (GPList), stored also in 
the viewer profile database 23. The GPlist contains all generalisation patterns from the 
case file. Each generalisation pattern in the GPList may be represented as follows: 
([intersection], occurrence), 
wherein intersection indicates a set of the features (fi) that are shared by different 
cases (Cj). Occurrence indicates the number of cases that share such an intersection. For 
example, from the following cases: 
Cl=(fl,f2, £3,f4, f7); 
C2 = (fl,f2, f5, f6, f7); and 
C3 = (£3, f5, f6, f8) 
the GPList generated from the three cases has three items: 
([fl,£2, f7],2); 
([£3], 2); and 
([S, f6], 2) 

The first GPList entry above arises from the features fl , f2 and f7 occurring both 
in cases CI and C2. The other entries are derived in a similar manner. 

Each time new cases (Cj) become available through selections by the viewer of 
programs to watch, those new cases are added to the case file and a new GPList is 
generated by the learning module 39. Assume for example that the case file contains the 
following three cases: 
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Cl = {Category = 'drama', Sub-category = ' comedy-drama \EPG channel = 'Nhk'); 
C2 = (Category = 'drama', Sub-category = 'war', £PG channel = 'Nhk', StartTime = '21:00'); and 
C3 = (Category = 'sports', EPG channel = 'Wow', StartTime = '8:15', Day = 'Sat'). 
The GPList generated by the learning module would only include: 
([Category = 'drama', EPG channel = 'Nhk'], 2) 

When new viewer selections 68, and therefore further cases, became available, for 
example 

C4 = (Category = 'drama', Sub-category = 'Talk', EPG channel = 'Nhk'); and 
C5 = (Category = 'sports', Sub-category = 'Current affairs', StartTime = '10:00', Day = 'sat') 
cases C4 and C5 are added to the case file and the GPList is recalculated by the 
learning module 39 to contain the following entries: 
([Category = 'drama', EPG channel = c Nhk'], 3) 
([Category = 'sports', Day = 'Sat'], 2) 

A procedure MAIN for performing the core function in the learning module 39 is 
shown in Fig. 7A. Three data structures are used in the procedure namely, the Case-file 
which contains a number of cases (Cj), the GPList which keeps all generalisation patterns, 
and an Examined-case-list which contains cases that are already processed. Initially, 
upon initiation of the procedure MAIN when a viewer requested for recommendations, 
the GPList and the Examined-case-list are empty. 

The procedure MAIN starts in step 200 by first obtaining a list of new cases in 
step 201 and the Case-file from the viewer profile database in step 202. A sub-routine 
UPDATE-CASE-FILE is called in step 203 for updating the Case-file by adding the new 
cases. The sub-routine UPDATE-CASE-FILE starts at step 212 in Fig. 7B. 

Intersections for each case of the Case-file with the current GPList is obtained in 
the remaining steps 204 to 21 1. A first entry from the Case-file is taken in step 204 and 
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used as an input case when calling sub-routine GEN-CASE-GPList in step 205. Sub- 
routine GEN-CASE-GPList finds the generalization patterns between the input-case and 
items in the GPList and starts at step 220 in Fig. 7C. Sub-routing GEN-CASE- 
EXAMINED-CASES is called in step 206 for finding generalization patterns between 
the input-case and the cases in the Examined-case-list. Sub-routing GEN-CASE- 
EXAMINED-CASES starts at step 310 in Fig. 7H. In step 207, the input-case is added 
to the Examined-case-list. Cases (Cj) are therefore progressively moved from the Case- 
file to the Examined-case-list until the Case-file is empty. Step 208 determines whether 
Case-file has any more entries. If there are any remaining entries in the Case-file, the 
procedure MAIN proceeds to step 209 where the next entry from Case-file is used as 
input-case and the procedure MAIN continues to step 205. 

After step 208 determines that the Case-file is empty, the procedure MAIN 
produce generalization patterns in the GPList as an output in step 210 and ends in step 
211. 

Referring now to Fig. 7B wherein the sub-routine UPDATE-CASE-FILE is 
shown. This sub-routine includes the new cases produced as input in step 201 in 
procedure MAIN and into them into the current Case-file. It receives the entries from the 
list of new cases in step 213 and taking a next new case from the list of new cases in step 
214, the next new case is added onto the end of the Case-file. Step 216 determines 
whether all the new cases has been dealt with and proceeds to steps 217 and 215 where 
the next entry is added to the Case-file. An updated Case-file is produced as output in 
step 219 and the sub-routine UPDATE-CASE-FILE ends in step 219. 

Referring to Fig. 7C , the sub-routine GEN-CASE-GPLIST is to find all 
generalization patterns between the input-case and all items in the GPList. It further 
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updates the GPList with all new generalization patterns between the input-case and the 
current GPList. 

GEN-CASE-GPLIST starts in step 220 and receives the input case and the 
current GPList as inputs in step 22 L It is determined in step 222 whether the current 
GPList is still empty. If the current GPList is empty, then no generalization patterns 
between the input-case and the GPList can exist and the sub-routine returns in step 236. 

With items in the GPList, the sub-routine continues to step 223 wherein all 
generalization patterns between the input-case and all items in the GPList are found by 
calling sub-routine G_List_GEN. The generalization patterns are put in a G_List, which 
contains potential generalization patterns between the input-case and the GPList. The 
subroutine G_List_GEN starts at step 240 in Fig. 7D. 

It is determined in step 224 whether the GJList is empty. If the GList is empty, 
then no generalization patterns between the input-case and the GPList was found by sub- 
routine G_List_GEN and the sub-routine GEN-CASE-GPLIST returns in step 236. 

With items in the G_List, the sub-routine GEN-CASE-GPLIST continues to step 
225 where subroutine UG_List_GEN is called. Subroutine UG_List_GEN starts at step 
260 in Fig. 7E, and forms a unique generalisation pattern list, UG_List, from the GJList. 

A first item from the UG_List, UG_Item, is retrieved and the intersection, 
First_Intersection, from the UG_Item is extracted in step 226. A first item from the 
GPList, GPList_Item, is retrieved and the intersection, Second_Intersection, from the 
GPList_Item is extracted in step 227. 

Step 228 calls sub-routine INTJMATCH to determine whether First_Intersection 
and Second_Intersection match. Sub-routine INT_MATCH starts at step 280 in Fig. 7F. 
If step 228 finds that First_Intersection and Secondlntersection match, the occurrence of 
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GPList ltem is made equal to that of UG_Item in step 229. The sub-routine continues to 
step 233. 

If step 228 finds that Firstjhtersection and Second_Intersection do not match, 
then step 230 determines whether all items of the GPList have been considered. If items 
remain, the next item in the GPList is retrieved with it's intersection as 
Second_Intersection in step 231, before step 228 again determines whether 
First_Intersection and Second_Jntersection match. If step 230 determined that all items in 
the GPList have been considered, then the UG Item is added to the GPList in step 232 
and the sub-routine continues to step 233. 

If step 233 determines that all items in the UG_List have not been considered, 
then the next item in the UG_List is retrieved with it's intersection as First_Intersection in 
step 234 and followed by step 227. Alternatively, if step 233 determines that all items in 
the UG_List have been considered, the sub-routine GEN-CASE-GPLIST outputs the 
GPList in step 235 and returns in step 236. 

Referring to Fig. 7D, sub-routine G _List_GEN is described, which determines all 
generalisation patterns between the input-case with all items in the GPList. Starting at 
step 240 , it receives as inputs the input-case and the GPList. The inputs are obtained in 
step 241. A first generalisation pattern, GPList_Item is obtained from the GPList in step 
242, a first feature from the input case is retrieved in step 243 and a first feature from the 
intersection part of the GPList_Item is retrieved in step 244. Step 245 determines 
whether the retrieved feature from the input-case is the same as the retrieved feature from 
the GPList_Item. If no match is found in step 245, step 246 determines whether all 
features from the GPList_Item has been dealt with. With more features in the 
GPList_Item remaining, step 255 retrieves a next feature from the GPList_Item and 
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continues to step 245. If all the features in the GPList_Item were considered, the sub- 
routine continues to step 247. 

If step 245 responds in the affirmative, step 252 determines whether a new 
generalization pattern has been created and create one in step 253 if required, or if it was 
already done, proceeds to step 254, where the shared feature is added to the new 
generalization pattern. The sub-routine continues to step 247 where it is determined 
whether all features from the input-case have been dealt with. If there are remaining 
features in the input-case, step 256 retrieves the next feature from the input-case. 

If step 247 determined that all the features from the input-case were considered, 
step 248 determines whether a new generalisation pattern was created in step 252. If the 
generalisation pattern already existed in the intersection parts of the GPList, the sub- 
routine continues to step 249 where the occurrence of the new generalisation pattern is 
given a value of the GPList Item that has the same intersection plus 1. In step 250 the 
new generalisation pattern is added to the G_List. 

If step 248 determined that the new generalisation pattern does not already exist in 
the GPList, then the sub-routine continues to step 251. 

Step 251 determines whether all items from the GPList have been considered. If 
an item remains in the GPList, the sub-routine continues to step 257 where the next item 
in the GPList is retrieved and step 243 is executed. Alternatively, with all items in the 
GPList considered, the sub-routine G_List_GEN returns in step 259 after producing the 
new G_List as output in step 258. 

Referring to Fig. 7E, a sub-routine UG_List_GEN is shown that procedure forms 
a unique generalisation pattern list, UGJList. Starting in step 260, the sub-routine 
receives in step 261 the G_List as input. In step 262 the first generalisation pattern is 
copied from the G_List into the UG_List. A first item from the G_List, G_List_Item, is 
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retrieved and the intersection, First_Intersection, from the G_List_Item is retrieved in step 
263. A first item from the UGList, UGLisMtem, is retrieved and the intersection, 
Second_Intersection, from the UGList_Item is retrieved in step 264. 

Step 265 calls sub-routine INTJV1ATCH to determine whether First_Intersection 
and Second_Intersection match. Sub-routine INTJMATCH starts at step 280 in Fig. 7F. 
If First_Intersection and Second lntersection match, the higher occurrence of the two 
items, G_List_Item and UG_List_Item, is determined and saved as the occurrence of 
UG_List_Item in steps 269 and 270. The sub-routine continues to step 268. 

If First_Intersection and Second_Intersection do not match, step 266 determines 
whether all items of the UG_List have been considered. If items remain, the next item in 
the UG_List is retrieved with its intersection as Second_Intersection in step 271, before 
step 265 again determines whether First_Intersection and Second_Intersection match. If 
step 266 determined that all items in the UGJList have been considered, then the 
GJList_Item is added to the UGJList in step 267 and the sub-routine continues to step 
268. 

If step 268 determines that all items in the G_List have not been considered, then 
the next item in the G_List is retrieved with it's intersection as First_Intersection in step 
263 and followed by step 264. Alternatively, if step 268 determines that all items in the 
G_List have been considered, the sub-routine UG_LIST_GEN outputs the UG_List in 
step 273 and returns in step 274. 

Referring to Fig. 7F, subroutine INTJMATCH is shown which check whether the 
First_Intersection and the Second_Intersection, obtained as inputs in step 281, are the 
same. Step 282 retrieves the first feature from First_Intersection, named First-feature, 
followed by step 283 where the first feature from Second_Intersection, named Second- 
feature, is retrieved. Step 284 calls sub-routine FEATURE-SAME to determine whether 
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First-feature is the same as Second-feature. Sub-routine FEATURE-SAME starts at step 
300 in Fig. 7G. If they are the same, then step 285 determines whether all the features of 
First lntersection have been considered. If this is affirmative, then the sub-routine 
continues to step 286. If not, then step 296 retrieves the next feature from 
First_Intersection, names it First-feature and continues to step 283. However, if step 284 
determined that First-feature is not the same as Second-feature, then step 290 determines 
whether all the features of the Second_Intersection have been considered. If this is 
affirmative, then the sub-routine INTJMATCH returns a <c NO" in step 292. If features 
of the Second_Intersection remain, then step 291 retrieves the next feature from 
Second_Intersection, names it Second-feature and continues to step 284. 

Step 286 retrieves the first feature from Second_Intersection, named Second- 
feature, followed by step 287 where the first feature from First_Intersection, named First- 
feature, is retrieved. Step 288 calls sub-routine FEATURE-SAME to determine whether 
First- feature is the same as Second-feature. If they are the same, then step 289 determines 
whether all the features of Second_Intersection have been considered. If this is 
affirmative, then the sub-routine INTJMATCH returns a "YES" in step 298. If not, then 
step 297 retrieves the next feature from Second_Intersection, names it Second-feature and 
continues to step 287. However, if step 288 determined that First-feature is not the same 
as Second-feature, then step 293 determines whether all the features of the 
First lntersection have been considered. If this is affirmative, then the sub-routine 
INTJMATCH returns a "NO" in step 295. If features of the First_Intersection remain, 
then step 294 retrieves the next feature from First_Intersection, names it First-feature and 
continues to step 288. 

Referring now to Fig. 7G, sub-routine FEATURE-SAME is described, which 
checks whether two given features are the same. Therefore, in step 301 it receives as 
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inputs, First-feature and Second-feature. Step 302 gets the attribute of First-feature, 
named First- f-attribute, and step 303 gets the attribute of Second- feature, named Second- 
f-attribute. Step 304 gets the value of First-feature, named First-f- value, and step 305 gets 
the value of Second-feature, named Second-f-value. 

Step 306 determines whether First-f-attribute is the same as Second-f-attribute, 
and step 307 determines whether First-f-value is the same as Second-f- value. If the 
answers of both steps 306 and 307 are affirmative, then sub-routine FEATURE-SAME 
returns a "YES" in step 309. If any one of the answers of steps 306 and 307 is negative, 
then sub-routine FEATURE-SAME returns a "NO" in step 308. 

Sub-routine GEN-CASE-EXAMINED-CASES starts in step 310 in Fig. 7H. 
This sub-routine finds generalisation patterns between the input-case from Case-file and 
cases in the Examined-case-list, which it receives as inputs in step 311. Step 312 
determines whether the Examined-case-list is empty and returns in step 313 if this is 
affirmative. IF the Examined-case-list has items, the sub-routine continues to step 314 
where the first case from the Examined-case-list is retrieved. Step 315 calls subroutine 
GET-GEN-PATTERN to calculate a generalisation pattern, Gen-pattern, between the 
input-case and the case from the Examined-case-list. Subroutine GET-GEN-PATTERN 
starts at step 330 in Fig. 71. 

Step 316 determines whether a Gen-pattern has been found. If a Gen-pattern has 
been found, the sub-routine determines in step 317 whether the Gen-pattem match any 
item in the GPList by calling sub-routine IF-MATCH. Sub-routine IF-MATCH starts at 
step 350 in Fig. 7J. If the Gen-pattem does not match any item in the GPList, then step 
318 adds Gen-pattem to GPList as a new item and continues to step 319. If step 317 find 
that the Gen-pattem match an item in the GPList, then the sub-routine continues to step 
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319 where it is determined whether all cases in the Examined-case-list have been 
considered. 

If step 319 determines that cases in the Examined-case-list remain to been 
considered, then step 320 retrieves the next case from the Examined-case-list and 
continues to step 315. Alternatively, step 321 outputs the GPList and the sub-routine 
GEN-CASE-EXAMINED-CASES returns in step 322. 

Referring to Fig. 71, wherein sub-routine GET-GEN-PATTERN for identifying a 
generalization pattern, Gen-pattem, between an input-case from the Case-file and one 
case from the Examined-case-list, is shown. The sub-routine starts in step 330 by 
obtaining input-case and a case from the Examined-case-list as inputs in step 33 1 .It takes 
these two cases as input and compares their features. If some features are shared by the 
two cases, then these shared features will be included in the intersection part of Gen- 
pattern. The occurrence in Gen-pattern will be 2. Otherwise, if no features are shared 
between the cases, an empty Gen-pattern will be produced as output. 

Step 332 retrieves the first feature from the input-case, named First-feature, 
followed by step 333 where the first feature from the case from the Examined-case-list, 
named Second- feature, is retrieved. Step 334 calls sub-routine FEATURE-SAME to 
determine whether First-feature is the same as Second-feature. Sub-routine FEATURE- 
SAME starts at step300 in Fig. 7G. If they are the same, then step 335 would keep this 
feature in the intersection part of Gen-pattem and proceeds to step 338. If step 334 
determined that the features were not the same, then step 336 determines whether all the 
features of the case from the Examined-case-list have been considered. If this is 
affirmative, then the sub-routine continues to step 338. If not, then step 337 retrieves the 
next feature of the case from the Examined-case-list, names it Second-feature and 
continues to step 334. Step 338 determines whether all features of the input-case have 
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been considered. If this is affirmative, then the sub-routine continues to step 340. 
However, if step 338 determined that all the features of the input-case have not been 
considered, then step 339 retrieves the next feature of the input-case, names it First- 
feature and continues to step 333. 

Step 340 determines whether the Gen-pattern is empty. If the Gen-pattern is not 
empty, then the occurrence of Gen-pattern is made 2 and the subroutine GET-GEN- 
PATTERN returns in step 343 after producing as output Gen-pattern in step 342. If step 
340 determines that Gen-pattem is empty, the sub-routine GET-GEN-PATTERN also 
returns in step 343. 

Referring to Fig. 7J, sub-routine IF-MATCH is shown. This sub-routine is to 
check whether the intersection of the generalisation pattern of Gen-pattern matches the 
intersection of GPList. The sub-routine starts in step 350 and accepts Gen-pattem and 
GPList as inputs in step 351. 

Step 352 extracts the intersection part of Gen-pattem and name it Gen- 
intersection. Step 353 retrieves the first item from GPList and the intersection part of this 
item is extracted and named GP-intersection in step 354. 

Step 355 calls sub-routine IF-SAME, which starts at step 370 in Fig. 7K, to 
determine whether Gen-intersection and GP-intersection are the same. If a match is 
found, then the sub-routine IF-MATCH returns a "YES" in step 359. If a match was not 
found in step 355, then step 356 determines whether all the items of GPList have been 
considered. If this is affirmative, then the sub-routine IF-MATCH returns a tc NO" in 
step 360. However, If step 356 determines that there are items of GPList that were not 
yet considered, then step 357 retrieves the next item from the GPList, step 358 extracts 
the intersection part of the item and name it GP-intersection and the sub-routine continues 
to step 355. 
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Referring to Fig. 7K, subroutine IF-SAME is shown which check whether Gen- 
intersection and GP-intersection, obtained as inputs in step 371, are the same. Step 372 
retrieves the first feature from Gen-intersection, named First-feature, followed by step 
373 where the first feature from GP-intersection, named Second- feature, is retrieved. 
Step 374 calls sub-routine FEATURE-SAME to determine whether First-feature is the 
same as Second-feature. Sub-routine FEATURE-SAME starts at step300 in Fig. 7G. If 
they are the same, then step 378 determines whether all the features of Gen-intersection 
have been considered. If this is affirmative, then the sub-routine continues to step 379. If 
not, then step 388 retrieves the next feature from Gen-intersection, names it First-feature 
and continues to step 373. However, if step 374 determined that First- feature is not the 
same as Second-feature, then step 375 determines whether all the features of the GP- 
intersection have been considered. If this is affirmative, then the sub-routine IF-SAME 
returns a "NO'* in step 292. If features of the GP-intersection remain, then step 376 
retrieves the next feature from GP-intersection, names it Second-feature and continues to 
step 374. 

Step 379 retrieves the first feature from GP-intersection, named First-feature, 
followed by step 380 where the first feature from Gen-intersection, named Second- 
feature, is retrieved. Step 381 calls sub-routine FEATURE-SAME to determine whether 
First- feature is the same as Second-feature. If they are the same, then step 385 determines 
whether all the features of GP-intersection have been considered. If this is affirmative, 
then the sub-routine IF-SAME returns a "YES" in step 386. If not, then step 387 
retrieves the next feature from GP-intersection, names it First-feature and continues to 
step 380. However, if step 381 determined that First-feature is not the same as Second- 
feature, then step 382 determines whether all the features of the Gen-intersection have 
been considered. If this is affirmative, then the sub-routine IF-SAME returns a "NO" in 
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step 384. If features of the Gen-intersection remain, then step 383 retrieves the next 
feature from Gen-intersection, names it Second-feature and continues to step 381. 

In Fig. 6, an example of a viewer profile 500 for a particular viewer is shown. 
The Viewer profile 500 may correspond to the GPList determined by method shown in 
Figs. 7A to 7K, performed by the learning module 39 of the avatar agent 37 associated 
with the particular viewer, with the GPList having the following intersections and 
occurrence values: 

([Category = 'drama'], 6) 

([Category = 'drama', Sub-category = 'social 5 , Year_of_make = '1999'], 3) 

([Category = 'drama', Sub-category = 'social', Start_Time = '2200', Year_of_make 
= '1999'], 2) 

([Sub-category = 'social'], 8) 

([Sub-category = 'drama', Day = 'Thu'], 2) 

([Category = 'movie'], 10) 

([Sub-category = 'social', Day = 'Mon'], 2) 

([Category = 'drama', Sub-category = 'social'], 5) 

([Sub-category = 'social', Day = 'Wed'], 2) 
The columns 501 in Fig. 6 represent the attributes of the intersections and the 
entries represent the values 502 of the attributes. Each row 503 in the viewer profile 500 
represents an item in the viewer profile 500. Each item 503 in the viewer profile 500 also 
has a Date_Stamp entry. In the preferred embodiment, the Date_Stamp value of the item 
503 is the date of the most recent viewer program selection 68 that contributed to the 
intersections in the item 503. Alternatively, the DatejStamp value may be the average of 
the dates of all viewer program selections 68 that contributed to the intersections in the 
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item 503. For example, the item 503 in the third row has the following values and 
interpretation: 



Attribute 


Attribute-value 


Interpretation 


Category_BD 


16 


Category = 'drama' 


Subcategory ID 


564 


Sub-category = 'social' 


Start_Time 


2200 


Start_Time = '2200' 


Day 


-1 


Don't care 


EPG_channel 


-1 


Don't care 


YearofMake 


1999 


Yearj)f_make = '1999' 



The occurrence of this intersection is 2 and the last time the viewer made a 
program selection 68 that contributed to this intersection was 24 April 1999. All entries 
with "-1", are interpreted as "Don't care". 

Operations within the recommendation module 40 will now be described in more 
detail. The recommendation module 40, according to the preferred embodiment, uses a 
number of tasks to compile the list of viewer recommendations 67. Various tasks are 
defined, with each task defining a unique combination of a manner of ordering the viewer 
profile 500, and particular Relevance Filters for filtering the ordered viewer profile. 

The first aspect of each of the tasks, in accordance with the present embodiment, 
is the manner in which the viewer profile 500 is ordered. The ordering arrangements may 
include: 

• WeightFactor Ordering arranges the viewer profile entries 503 by descending 
occurrence value, ie. feature (fi) intersections occurring most frequently take 
precedence. 
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Specificity Ordering arranges the viewer profile entries 503 by descending 
specificity level, ie. entries 503 which specify more program attribute-value pairs 
than others take precedence. 

Generality Ordering arranges the viewer profile entries 503 by ascending 
specificity level, ie. entries 503 which specify less program attribute-value pairs 
that others take precedence. 

Recency Ordering arranges the viewer profile entries 503 by descending 
Date_Stamp, ie. most recent entries 503 take precedence. 

WeightRecency Ordering arranges the viewer profile entries 503 by descending 
occurrence value, while preferring entries 503 having most recent Date_Stamp 
values when occurrence values are the same. 

Specificity Weight Ordering arranges the viewer profile entries 503 by 
descending specificity level, while preferring entries 503 having higher 
occurrence values when specificity levels are the same. 

Generality Weight Ordering arranges the viewer profile entries 503 by 
ascending specificity level, while preferring entries 503 having higher occurrence 
values when specificity levels are the same. 

Recency Specificity Ordering arranges the viewer profile entries 503 by 
descending Date_Stamp, while preferring more specific entries 503 when 
Date_Stamp values are the same. 

The following possible orderings may be useful: 

Specificity Recency Ordering arranges the viewer profile entries 503 by 
descending specificity level, while preferring most recent entries 503 when 
specificity levels of entries are the same. 
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• Generality Recency Ordering arranges the viewer profile entries 503 by 
ascending specificity level, while preferring most recent entries 503 when 
specificity levels of entries are the same. 

The second aspect of each of the tasks, in accordance with the present 
embodiment, is the particular Relevance Filters applied to the ordered viewer profile, 
which includes: 

• TimeSlot Filter verifies whether a viewer profile entry 503 is time- or day- 
specific and verifies the specific time and/or day with the day and time for which 
recommendations are requested. 

Condition to reject Viewer profile entries 503: Start_Time is specified in the 
viewer profile entry 503, but is not equal to the time for which recommendations 
are requested or Day is specified in the viewer profile entry 503, but is not equal 
to the day for which recommendations are requested. The TimeSlot Filter is 
included in all filter operations. 

• WeightFactor Filter verifies whether a viewer profile entry 503 has an 
occurrence value that is higher than a current average occurrence value of all the 
viewer profile entries 503. 

Condition to reject Viewer profile entries 503: Occurrence value <= average 
occurrence value. 

• Popularity Filter verifies whether a viewer profile entry 503 corresponds to a 
(currently) popular event/program, eg. Football World Cup, Celine Dion concert. 
Condition to reject viewer profile entries 503: When the POPULARITY value is 
false. 
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• Urgency Filter verifies whether a viewer profile entry 503 may be met by an 
urgent program, eg. special news/progress reports, weather announcements 
(tornado warnings, etc.), press conferences, nation addresses and so on. 
Condition to reject viewer profile entries 503: When the URGENCY value is 
false. 

• LifeStyle Filter verifies whether a viewer profile entry 503 corresponds to a 
(known) type of a lifestyle, eg., Midday movies, 7pm news, or Saturday night 
music shows. 

Condition to reject Viewer profile entries 503: When the LIFESTYLE value is 
false. 

By combining filter characteristics together, other filters can be obtained. For 
example, 

• PopuIarLifeStyle Filter verifies whether a viewer profile entry 503 corresponds 
to a (known) type of a lifestyle and (currently) popular event/program, eg., Celine 
Dion concert on Saturday night. 

Such combinations are significantly restrictive, and a task filtering ordered viewer 
profile entries with a combined filter may reject most if not all viewer profile entries 503. 
Therefore, it is expected that only a small proportion of viewers (most demanding ones) 
may value a task that includes such a filter. 

Certain of the tasks provide recommendations due to more established Viewer 
profile entries 503 (gradual change), whereas other tasks attempt to produce viewer 
recommendations based on a sudden change in the viewer's viewing habits. 
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Using combinations of both the first (ordering) and second (filtering) aspects of 
the tasks, a number of useful tasks may be defined including: 
Gradual Change Tasks 

Basic Task = Weight Factor Ordering + TimeSlot Filter 

(broad-minded viewer) 
DieHard Task = Specificity Weight Ordering + WeightFactor Filter 

(old habits die hard) 
OldFavourites Task = Generality Weight Ordering + WeightFactor Filter 

(original recipe) 

BestPick Task = Specificity Weight Ordering + Popularity Filter 

(choosy viewer) 

Prime Time Task = Weight Recency Ordering + LifeStyle Filter 

(my TV - my castle) 

Sudden Change Tasks 

HotTopic Task = Recency Specificity Ordering + Popularity Filter 

(sudden change due to life style change) 
NewLife Task = Recency Specificity Ordering + LifeStyle Filter 

(sudden change due to life style change) 
WatchDog Task = Recency Specificity Ordering + Urgency Filter 

(sudden change due to crisis situation). 
Because different viewers may be satisfied with viewer recommendations 
produced as a result of the execution of different tasks, each task has an associated viewer 
specific TaskValue, indicating the particular viewer's satisfaction with the viewer 
recommendations 67 provided by the particular task. The Task_Value is also stored in 
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the viewer profile database 23 and each task, represented by a unique TaskJDD, may be 
stored as follows: 



TaskID 


Number 


Task_Value 


Number 


TaskType 


gradual or sudden change 



Generally, an optimal set of viewer recommendations 67 is obtained as a result of 
a balance between various tasks. In the preferred embodiment, a combination of gradual 
change tasks and sudden change tasks is used to compile the viewer recommendations 67. 

Referring to Fig. 9A, when the recommendation module 40 is instructed by the 
avatar manager 38 to provide television program recommendations, the procedure 
RECOMMEND is started in step 601. In step 602 the procedure RECOMMEND 
receives as inputs: 

• The Viewer profile 500 from the viewer profile database 23, which includes 
viewer profile entries 503. Each viewer profile entry 503 includes the intersecting 
features, the Date_Stamp and the occurrence count; 

• The viewer specific Task_Values; 

• A list of program entries and their features (fi), retrieved from the EPG 
databases 22; and 

• A predetermined desired number of recommended programs R. 

In step 603 a counter / is set to a value of 1. A variable K is also set, where K 
represents the number of tasks used by the recommendation module to provide viewer 
recommendations 67. In the preferred embodiment, the gradual change task having a 
maximum Task_Value and all the sudden change tasks are used. Hence, the variable K is 
set as the number of sudden change tasks plus 1. 
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This is followed by step 604 where a task, identified by its Task_ID, is chosen. 
With the counter / equal to 1 , step 604 chooses the gradual change task with a maximum 
Task_Value. If the counter / is larger than 1, the next sudden charge task is chosen. 

Step 605 sets a variable ot/. The variable a/ represents the desired portion of 
viewer recommendations that the recommendation module 40 would determine that 
would be made up from the task chosen in step 604. Accordingly, the variable a/ is set as 
l/(2n), with n being 1 or K-l for gradual and sudden change tasks respectively. 

Step 606 calls sub-routine REASON for applying the chosen task and for 
producing viewer recommendations 67. Sub-routine REASON starts at step 650 in Fig. 
9B. 

Step 607 determine whether the REASON sub-routine has produced at least 1 
recommendation for the chosen task. If the REASON sub-routine was unable to produce 
the at least 1 recommendation, then the intersecting features of the viewer profile entry 
503 are relaxed in step 609. In the preferred embodiment, all intersections are ignored 
except for category and sub-category, if they exist as intersections. The procedure 
RECOMMEND returns to step 606 where the sub-routine REASON is called again with 
the relaxed features. 

If step 608 determines that the features of the viewer profile entry 503 were 
already relaxed, then the procedure RECOMMEND continues to step 621. 

If step 607 determines that the REASON sub-routine was able to produce at least 
one recommendation for the chosen task, then step 621 determines whether the counter / 
is still smaller than variable K. If the counter / has a value of K, then recommendations 
for the desired tasks have been produced and the procedure RECOMMEND continues to 
step 623 where the SetRecommendations message, containing a list of recommended 
programs, is passed to the avatar manager 38, from where it is sent to the DTV agent 36. 
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Alternatively, the recommendation module 40 may send the SetRecommendations 
message directly to the DTV agent 36. 

However, if step 621 determines that the counter 1 is smaller than variable K, then 
viewer recommendations for certain tasks must still be produced. Therefore, step 622 
increments the counter / and the procedure RECOMMEND returns to step 604 for 
determining viewer recommendations for a next task. 

Referring to Fig. 9B wherein the sub-routine REASON for applying the chosen 
task and for producing viewer recommendations is shown. Sub-routine REASON starts 
in step 650. 

Step 652 orders the viewer profile entries 503 by applying the ordering aspect of 
the task selected in step 604 of the RECOMMEND procedure. For example, if the 
gradual change task DieHard task was selected, then the viewer profile entries 503 are 
ordered by the Specificity Weight Ordering which arranges the viewer profile entries 503 
by descending specificity level, while preferring entries 503 having higher occurrence 
values when specificity levels are the same. Step 653 identifies the filter, specified by 
chosen task. For example, with the DieHard task, step 653 identifies the filter 
WeightFactor Filter, which verifies whether a viewer profile entry 503 has an occurrence 
value that is higher than a current average occurrence value of all the viewer profile 
entries 503. 

Step 655 sets a viewer profile entry counter j to a value of 1 and a 
recommendations counter r to a value of 0. In step 657 it is determined whether the y-th 
ordered viewer profile entry 503 satisfies the chosen filter from step 653. It is again noted 
that the TimeSlot Filter is always included in all filter operations whereby all viewer 
profile entries 503 with specific Start_Time, Start_Day or Start_Date (ie not equal to - 1: 
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don't care), and where the specific Start_Time StarMDay or Start_Date is not equal to the 
current time, current day or current date respectively, are removed. 

If step 657 determines that the j-th ordered viewer profile entry 503 does not 
satisfy the chosen filter, then the sub-routine REASON continues to step 677 for 
determining whether the viewer profile counter j is still smaller than the total number of 
viewer profile entries 503, N. 

Alternatively, if step 657 determines that the y-th ordered viewer profile entry 503 
does satisfy the chosen filter, then the sub-routine REASON continues to step 660 where 
a dymanic rule is build as EPG database filter by calling sub-routine 
BUILD_DYNAMIC_RULE. The sub-routine BUILD_DYNAMIC_RULE is shown in 
Fig. 9C and starts in step 700. 

Step 662 applies the rule that was built in the sub-routine 
BUILD_DYNAMIC_RULE on the entries 60 of the EPG databases 22 to identify m 
EPG database entries 60 that satisfies the rule. This is followed by step 665 which calls 
the sub-routine INTERPRET. Sub-routine INTERPRET builds a map of 
recommendations and is shown in Fig. 9D. 

Sub-routine PRODUCE is called in step 667 which produces an ordered list of 
viewer recommendations from the map of recommendations. Sub-routine PRODUCE is 
shown in Fig. 9E and starts in step 750. 

Step 672 calculates the recommendations counter r to be the previous count plus 
the number m of recommendations produced by sub-routine PRODUCE called in step 
667. Step 675 determines whether the recommendations counter r is smaller than the 
portion ot/ of the predetermined desired number R of recommended programs. If the 
determination of step 675 is negative, then a sufficient number of recommendations were 
created for that task and the sub-routine REASON continues to step 682. Alternatively, 
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if step 675 determines that not enough recommendations were created, the sub-routine 
REASON continues to step 680 where the list of ordered recommendations, is joined in a 
ranked set X. This is done by, for each entry from the ordered list of recommendations, 
determining whether the entry already exists in the ranked set X. If the entry already 
exists, the entry is ignored and the next entry is considered. However, if the entry does 
not yet exist, then it is entered at the end of the ranked set X. 

Step 677 then determines whether the viewer profile counter j is still smaller than 
the total number of viewer profile entries 503 and if so, directs the sub-routine REASON 
to step 658 where the counter j is incremented before directing the sub-routine back to 
step 657. This allows more recommendations to be determined by finding a next viewer 
profile entry 503 that meet the filter criteria. 

From step 675, or from step 677 when all the viewer profile entries 503 have been 
considered, the sub-routine REASON returns to the procedure RECOMMEND in step 
682. 

Referring to Fig. 9C wherein the sub-routine BUILD_DYMANIC_RULE is 
shown. Sub-routine BUILD_DYMAMCJRULE builds a dynamic rule for the ordered 
viewer profile entry 503 that satisfied the chosen filter, and starts in step 700. 

Step 702 sets a string Y as the source of the EPG program database 22. The string 
Y, and hence the EPG program database 22 is formulated in a string "tmp" in step 705. 
Steps 707 to 712 set variables day, hours and minutes as the date and time for which 
recommendations should be provided. This date and time were obtained from the DTV 
agent in the SendRecommendationRequest message. The variables day, hours and 
minutes are added to the string "tmp", allowing a 2 hour window around the hours 
variable. 
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Step 715 determines whether the intersecting features of the viewer profile entry 
503 were relaxed by performing step 609. The sub-routine BUILD_DYMANIC_RULE 
continues to step 718 if the intersecting features of the viewer profile entry 503 were 
relaxed, where the category of the ordered viewer profile entry 503, if it is not equal to -1 
(don't care), is added to the string "tmp". Similarly, in step 719 the sub-category of the 
ordered viewer profile entry 503 is added to the string "tmp" if it is determined not to be 
equal to -1 (don't care). The sub-routine then proceeds to step 720. 

If step 715 determines that the intersecting features have not been relaxed, then 
step 717 determines whether all the attributes of the ordered viewer profile entry 503 have 
been processed. If so, then a string "rule" is set to be equal to the string "tmp" in step 720 
before sub-routine BUILD_DYMANIC_RULE returns to the sub-routine REASON in 
step 729. 

However, if there are unprocessed attributes of the ordered viewer profile entry 
503, then steps 722 and 725 gets the next attribute whose value is not -1 (don't care) and 
add that attribute to the string "tmp". The sub-routine continues to step 717. 

Referring now to Fig. 9D wherein the sub-routine INTERPRET is shown. Sub- 
routine INTERPRET builds a map of recommendations from the returned EPG database 
entries 60, and starts in step 730. 

The sub-routine INTERPRET is initialised in step 732 by setting the map of 
viewer recommendations as empty, and setting a counter c as 1. Step 735 gets the c-th 
entry of the returned EPG database entries 60 and step 737 adds this entry to the map of 
recommendations according to the category of the entry. The map of recommendations 
will have as entries rows having the categories, followed by all the returned EPG database 
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entries 60 having a particular category as a feature. Each row would typically have a 
different number of fields. 

Step 740 determines whether the variable c is smaller than the total of returned 
EPG database entries 60, or in other words, whether all the returned EPG database entries 
60 have been entered into the map of recommendations. If it is determined in step 740 
that all the returned EPG database entries 60 have not been added, then the variable c is 
incremented in step 742 and the sub-routine INTERPRET continues again to step 735. 

However, if step 740 determines that all the returned EPG database entries 60 
have been added to the map of recommendations, then step 745 returns the sub-routine 
INTERPRET to the subroutine REASON. 

Referring to Fig. 9E wherein the sub-routine PRODUCE for producing m viewer 
recommendations is shown. Sub-routine PRODUCE starts in step 750. 

The sub-routine PRODUCE is initialised in step 752 by setting the vectors of 
recommendations as empty, and setting a counter h as 1. Step 755 gets the h-th row from 
the recommendations map and step 757 retrieves a first component of the h-th row of the 
recommendations map as the category ID and a second component as all the returned 
EPG database entries 60 (or programs) with that category as a feature. Step 758 adds the 
first and second components together into a vector of categorised recommendations. 

Step 760 determines whether the variable h is smaller than the total number of 
rows in the recommendations map, or in other words, whether all the rows in the 
recommendations map have been converted into vectors. If it is determined in step 760 
that the recommendations map has not been fully converted, then the variable h is 
incremented in step 761 and the sub-routine PRODUCE continues again to step 755. 
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However, if step 760 determines that all the rows of the recommendations map 
have been converted, then step 762 returns the sub-routine PRODUCE to the subroutine 
REASON. 

When the avatar manager 38 receives the message SetProgramSelection 
from the DTV agent 36 (step 13 of Table 2), indicating that the viewer has selected a 
particular program 68, the avatar manager 38 calls routine ON_PROGRAM_SELECT, 
which is shown in Fig. 9F and starts in step 770. Step 775 determines whether the 
selected program was within the first half of the ranked list of recommendations X. If this 
determination is found to be true, then a variable mc, which is a Task_Value increment, is 
set to a positive value in step 776. Alternatively, the variable inc is set to a negative value 
in step 777. 

After setting the variable inc in step 776 or step 777, step 782 adds the variable inc 
to the TaskJValue of the Gradual Change task selected in step 604 of the 
RECOMMEND procedure. Therefore, if the selected program is in the upper halve of 
the set of ranked recommendations X, then the viewer recommendation 67 are deemed to 
have been successful, and the TaskJValue of the gradual task used by the 
recommendation module 40 is increased, thereby ensuring that it will again be used for 
future recommendations. However, if the selected program was listed in the lower half of 
the set of ranked recommendations X, the recommendation possibly was not optimal, and 
the Task_Value of the gradual task used by the recommendation module 40 is decreased. 

In an alternative embodiment, sub-routine INTERPRET records the Task_ID of 
the task(s) producing each of the recommendations. This allows the routine 
ONJPROGRAMJSELECT to only adjust the TaskJValue of the task that produced the 
selected recommendation. 
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The methods of Figs 7A to 7K and Figs. 9A to 9F may be practiced using a 
conventional general-purpose computer system 100, such as that shown in Fig. 8 wherein 
the processes of Figs 7A to 7K and Fig. 9 may be implemented as software, such as an 
application program executing within the computer system 100. In particular, the steps 
may be instructions in the software that are carried out by the computer. The software 
may be stored in a computer readable medium, including the storage devices described 
below. The software is loaded into the computer from the computer readable medium, 
and then executed by the computer. A computer readable medium having such software 
or computer program recorded on it is a computer program product. The use of the 
computer program product in the computer preferably effects an advantageous apparatus 
in accordance with the embodiments of the invention. 

The computer system 100 comprises a computer module 102, input devices such 
as a keyboard 110 and mouse 112, output devices including a printer 108 and a display 
device 104. 

The computer module 102 typically includes at least one processor unit 114, a 
memory unit 118, for example formed from semiconductor random access memory 
(RAM) and read only memory (ROM), input/output (I/O) interfaces including a video 
interface 122, and an I/O interface 116 for the keyboard 110 and mouse 112. A storage 
device 124 is provided and typically includes a hard disk drive 126 and a floppy disk 
drive 128. A magnetic tape drive (not illustrated) may also be used. A CD-ROM 
drive 120 is typically provided as a non-volatile source of data. The components 114 
to 128 of the computer module 102, typically communicate via an interconnected bus 130 
and in a manner which results in a conventional mode of operation of the computer 
system 100 known to those in the relevant art. Examples of computers on which the 
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embodiments can be practised include IBM-PC's and compatibles, Sun Sparcstations or 
alike computer systems evolved therefrom. 

Typically, the application program of the preferred embodiment is resident on 
the hard disk drive 126 and read and controlled in its execution by the processor 114. 
Intermediate storage of the program may be accomplished using the semiconductor 
memory 118, possibly in concert with the hard disk drive 126. In some instances, the 
application program may be supplied to the viewer encoded on a CD-ROM or floppy disk 
and read via the corresponding drive 120 or 128, or alternatively may be read by the 
viewer from a network via a modem device (not illustrated). Still further, the software 
can also be loaded into the computer system 100 from other computer readable medium 
including magnetic tape, a ROM or integrated circuit, a magneto-optical disk, a radio or 
infra-red transmission channel between the computer module 102 and another device, a 
computer readable card such as a PCMCIA card, and the Internet and Intranets including 
email transmissions and information recorded on websites and the like. The foregoing is 
merely exemplary of relevant computer readable mediums. Other computer readable 
mediums may be practiced without departing from the scope and spirit of the invention. 

The methods of Figs 7A to 7K and Figs. 9A to 9F may alternatively be 
implemented in dedicated hardware such as one or more integrated circuits performing 
the functions or sub functions of Figs 7A to 7K and Fig. 9A to 9F. Such dedicated 
hardware may include graphic processors, digital signal processors, or one or more 
microprocessors and associated memories. 

The foregoing describes only some embodiments of the present invention, and 
modifications and/or changes can be made thereto without departing from the scope and 
spirit of the invention, the embodiment being illustrative and not restrictive. 
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The Claims defining the invention are as follows: 
Claims ! 

1. A recommendation system for making recommendations to a user of 
programs for viewing in a television system in which information regarding programs is 
made available as at least one program guide list, the system comprising: 

a first memory means for recording a plurality of characteristics associated with 
each program previously viewed by said user; 

a second memory means for recording each of a plurality of relationships and 
corresponding measures of acceptance of said user, with respect to program 
recommendations made in response to previous program requests; 

processing means for forming sets of said characteristics, each said set 
comprising at least two of said characteristics; 

task selection means for selecting from said relationships at least one 
relationship, wherein at least one of said selected relationships comprises a highest one of 
said measures of acceptance; 

ordering means for ordering said sets of characteristics using said selected 
relationship to produce ordered sets of characteristics; 

filtering means for filtering said ordered sets of characteristics using said 
selected relationship to produce filtered sets of characteristics; 

searching means for performing a search of each of said program guide lists for 
programs with information that best match said filtered sets of characteristics, giving 
preference to highest filtered sets of characteristics; and 

on-screen display means for notifying said user of an availability of programs 
that best match said filtered sets as program recommendations upon entry of a user 
request for program recommendations. 
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2. A recommendation system as claimed in claim 1, further comprising a 
update means for updating said measures of acceptance. 

3. A recommendation system as claimed in claim 2, wherein each of said 
relationships comprises a combination of at least a first type relationship and a second 
type relationship, said measure of said first type relationship being updated as a result of 
user selections made over an extended period of time and said measure of said second 
type relationship being updated as a result of user selections made over a shorter period of 
time. 

4. A recommendation system as claimed in claim 3, wherein each of said 
relationships comprises a combination of said first type relationship having a maximum 
measure of acceptance and all second type relationships. 

5. A recommendation system as claimed in any one of the proceeding 
claims, wherein said relationships are user specific. 

6. A recommendation system as claimed in any one of the proceeding 
claims, wherein each of said sets of characteristics has associated therewith a frequency 
of occurrence of each said set in programs previously viewed by said user. 

7. A recommendation system as claimed in any one of the proceeding 
claims, wherein each of said sets of characteristics has associated therewith a date, said 
date being indicative of when each said set occurred in programs previously viewed by 
said user. 
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8. A recommendation system as claimed in any one of the proceeding 

claims, wherein each of said relationships are defined by a filtering and a ordering 
command. 

■ 9. A recommendation system as claimed in claim 8, wherein said filtering 

command is selected from the list including TimeSlot Filter, WeightFactor Filter, 
Popularity Filter, Urgency Filter and LifeStyle Filter, as herein defined 

10. A recommendation system as claimed in claim 8 or 9, wherein said 
ordering command is selected from the list including WeightFactor Ordering, Specificity 
Ordering, Generality Ordering, Recency Ordering, WeightRecency Ordering, Specificity 
Weight Ordering, Generality Weight Ordering, Recency Specificity Ordering, Specificity 
Recency Ordering and Generality Recency Ordering, as herein defined. 

11. A method of making recommendations to a user of programs for 
viewing in a television system wherein: 

information regarding programs is made available as at least one program guide 

list; 

a plurality of characteristics associated with each program previously viewed by 
said user, and each of a plurality of relationships and corresponding measures of 
acceptance of said user, with respect to program recommendations made in response to 
previous program requests, have been recorded; 

said method comprising the steps of: 
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forming sets of said characteristics, each said set comprising at least two of said 
characteristics; 

selecting from said relationships at least one relationship, wherein at least one of 
said selected relationships comprises a highest one of said measures of acceptance; 

ordering said sets of characteristics using said selected relationship to produce 
ordered sets of characteristics; 

filtering said ordered sets of characteristics using said selected relationship to 
produce filtered sets of characteristics; 

performing a search of each of said program guide lists for programs with 
information that best match said filtered sets of characteristics, giving preference to 
highest filtered sets of characteristics; and 

notifying said user of an availability of programs that best match said filtered 
sets as program recommendations upon entry of a user request for program 
recommendations . 

12. A method as claimed in claim 11, comprising the further step of 
updating said measure of acceptance. 

13. A method as claimed in claim 12, wherein each of said relationships 
comprises a combination of at least a first type relationship and a second type 
relationship, said measure of said first type relationship being updated as a result of user 
selections made over an extended period of time and said measure of said second type 
relationship being updated as a result of user selections made over a shorter period of 
time. 

489073 .doc 



-48- 

14. A method as claimed in claim 13, wherein each of said relationships 
comprises a combination of said first type relationship having a maximum measure of 
acceptance and all second type relationships. 

15. A method as claimed in any one of claims 11 to 14, wherein said 
relationships are user specific. 

16. A method as claimed in any one of claims 11 to 15, wherein each of 
said sets of characteristics has associated therewith a frequency of occurrence of each said 
set in programs previously viewed by said user. 

17. A method as claimed in any one of claims 11 to 16, wherein each of 
said sets of characteristics has associated therewith a date, said date being indicative of 
when each said set occurred in programs previously viewed by said user. 

18. A method as claimed in any one of claims 11 to 17, wherein each of 
said relationships are defined by a filtering and a ordering command. 

19. A method as claimed in claim 18, wherein said filtering command is 
selected from the list including TimeSlot Filter, WeightFactor Filter, Popularity Filter, 
Urgency Filter and LifeStyle Filter as herein defined. 

20. A method as claimed in claim 18 or 19, wherein said ordering command 
is selected from the list including WeightFactor Ordering, Specificity Ordering, 
Generality Ordering, Recency Ordering, WeightRecency Ordering, Specificity Weight 
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Ordering, Generality Weight Ordering, Recency Specificity Ordering, Specificity 
Recency Ordering and Generality Recency Ordering as herein defined. 

21. A recommendation system substantially as described herein with 
reference to the accompanying drawings. 



22. A method substantially as described herein with reference to the 
accompanying drawings. 



DATED this Twenty-ninth Day of June, 2000 
Canon Kabushiki Kaisha 
Patent Attorneys for the Applicant 
SPRUSON & FERGUSON 
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Fig. 7B Sub-routine UPDATE-CASE-FILE 
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Fig. 7D Sub-routine G_List_GEN 
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Get the first feature of Second-intersection, 
which is called Second-feature 



Get the first feature from first-intersection, 
which is called First-feature 



Get the next feature of 
Second-intersection, which 
is called Second-feature 



No 




Fig. 7F Sub-routine INTJMATCH 
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FEATURE-SAME 
start 




3CO 



2Pi 



Input: 

1 . First-feature 

2. Second-feature j 



Get the attribute of First-feature, which is 
called First-f-attribute 



- 502 



Get the attribute of Second-feature, which is 
called Second-f-attribute 



-503 



Get the value of First-feature, which is called 
First-f-value 



5CX4 




Fig. 7G Sub-routine FEATURE-SAME 
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3/0 




Input: 

1 . The input-case. from 
Case-file ; 

2. the current Examined- 
case-list 



Return 



No 



Get the first case from the 
Examined -case-list 



•314- 



Get generalization pattern (Gen -pattern) 
between the input-case and the case 
from Examined-case-list by calling 
GET-GEN-PATTERN) 




No 



Get the next case from 
the Examined-case-list 



Yes 




Add Gen -pattern 
onto GPList as a 
new item 




Output: 
GPList 




Fig. 7H Sub-routine GEN-CASE-EXAMINED-CASES 
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3>30 



X33I 



GET-GEN-PATTERN 
start 




Input: 

1 . Input-case from the 
Case-file 

2. One case from 
Examined -case-1 i st 



Get the first feature from the input-case, 
which is named First-feature 



Get the first feature of the case from 
Examined-case-list, which is named 
Second-feature 



Get the next feature of the 
case from Examined -case- 
list, which is called Second- 
feature 



Get the next feature of 
input-case, which is 
called First-feature 



r-33>~) 



No 




-333 



Keep this feature in the 
intersection part of Gen- 
pattern 



33G 



33Q 



No . 



3<f/ 



Assign the occurrence in Gen- 
pattern as 2 



Output: 

Gen -pattern 



Fig. 71 Sub-routine GET-GEN-PATTERN 
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35TO 




Fig. 7 J Sub-routine IF-MATCH 
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IF-SAME 



3*1 



Get the first feature from Gen -intersection, 
which is named First-feature 



i 



Input: 

1 . Gen-intersection of Gen-pattern 

2. GP-intersection of one item fron 
GPList 



Get the first feature of the GP-intersection, 
which is named Second -feature 



Get the next feature of 
Gen-intersection, which 
is called First-feature 




'3*Z 



3^8 




Get the next feature GP- 
intersection, which is called 
Second-feature 



Get the first feature of the GP-intersection, 
which is called First— feature 



3* <o 



f Return \ 



382. 



Get the next feature of 
GP-intersection, which is 
called First-feature 




Get the next feature of Gen- 
intersection, which is called 
Second-feature 




Yp^y Return 
*A "No" 



Fig 7K Sub-routine IF-SAME 
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100 



'108 



104 



Display 



Printer 
Device 



.122 



Video 
Interface 



.118 



120 



I/O 

Interface 



Memory 



Processor 



CD-ROM 



I/O 

Interface 



114 



Keyboard 



Storage Device 




HDD 


FDD 





116 126 128 



110 



112 



102 



130 



.124 



Fig. 8 
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Fig. 9A Procedure RECOMMEND 
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657 




Build dynamic rule by calling 
BUILD DYNAMIC RULE 



662 



Fire dynamic rule 



665 

1 



Build map of recommendations 
by calling INTERPRET 





^680 


Join recommendations 


into ranked set 


A 




Y 




<^r<R.a/?^> 


675 ^^^3 





r=r+m 



Produce recommendations by 
calling PRODUCE 



672 



667 



Fig. 9B Sub-routine REASON 
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BUILD_DYNAMIC_RULE" 

start 



700 



Set Y='EPG Program' 



702 



tmp='select*from'+Y+'where' 



705 



day=current day 
hours=current time hours 
minutes=current time minutes 



707 



tmp=tmp+'Start_Day=day 



710 



tmp=tmp+'Start_Time>hours:minutes:00 and 
Start_time<minimum(hours+2,23):minutes:00' 



712 



715 



717 




718 



if category(upi)*-1 then tmp=tmp+ 
'and categorylD=category(upj)' 



719 



if subcategory(up,)^-1 then tmp=tmp 
'and subcategorylD=subcategory(upi)' 



722 



720 



rule=tmp 



get next attribute 



tmp=tmp+'and attribute_name=attribute(upj) 




Return 



725 




729 



Fig. 9C Sub-routine BUILD_DYNAMIC_RULE 
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Fig. 9D Sub-routine INTERPRET 
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PRODUCE 

start 




750 



/7=1 

empty vector of viewer recommendations 



get h-th row from recommendations map 



retrieve categorylD and programlist 



\ 

761 



add categorylD and 
programlist to vector 



758 



762 




760 



752 



755 



757 



Fig. 9E Sub-routine PRODUCE 
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Fig. 9F Routine ON_PROGRAM_SELECT 
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